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Abstract. We use generating functional analysis to study minority-game type 
market models with generalized strategy valuation updates that control the 
psychology of agents' actions. The agents' choice between trend following and 
contrarian trading, and their vigor in each, depends on the overall state of the 
market. Even in 'fake history' models, the theory now involves an effective overall 
bid process (coupled to the effective agent process) which can exhibit profound 
remanence effects and new phase transitions. For some models the bid process 
can be solved directly, others require Maxwell-construction type approximations. 



PACS numbers: 02.50.Le, 87.23.Ge, 05.70.Ln, 64.60.Ht 
1. Introduction 

Minority games (MG) [l] [2] are simple models proposed about a decade ago to understand 
the origin of the cooperative phenomena and nontrivial fluctuations observed in financial 
markets, on the basis of so-called inductive decision making by imperfect interacting agents 
[3]- With the recent exposure of the inadequacy of classical economic modeling that assumes 
full rationality, intelligence and honesty of market players and evolution to an efficient stable 
market, the case for the alternative MG approach to market models is probably beyond 
discussion. The further strength of MG-type models is that they can be solved analytically; 
especially the generating functional analysis (GFA) method has proven to be an effective tool 
in this field [4l[5]|6]. We refer to the recent textbooks [T] |8] for historical backgrounds, the 
connection between MGs and markets, details on mathematical methods, and full references. 

Standard MG models are now understood reasonably well, so the next task is to 
generalize the mathematical technology developed so as to apply to models that are more 
realistic economically. In this paper we try to contribute to this aim, by studying analytically 
MG-type models in which we generalize the agents' strategy valuation rules: the strategy 
type to be rewarded (and by how much) depends on the overall market bid A. Agents can 
switch from a contrarian to a trend-following strategy, and adjust their level of caution, on 
the basis of how anomalous they perceive the market to be. Such ingredients are incorporated 
easily into the fabric of MG-type models, by enhancing the valuation update with a function 
F[A] of the excess demand; the question is how to decide which agent behaviour should be 
encoded in this function, and how to solve mathematically the resulting GFA equations. 

By changing the magnitude of the valuation updates in the MG in an yl-dependent way, 
we can model a preference of agents (who remain contrarians) for profitable decisions with 
large excess demand/supply (high-risk high-gain behaviour), or model the opposite situation 
where they prefer small excess demand/supply (low- risk low-gain behaviour). If we also allow 
agents to switch to trend-following, there are two possible routes. One could argue that when 
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markets are booming, equity prices tend to rise slowly and the trading volume increases (so 
agents are trend-followers, as in the majority game |10)). until the magnitude |j4| of the 
overall market bid becomes too large, leading to turmoil and contrarian behaviour. This was 
the view of 112) . Alternatively, one could argue that for small |^| the market would be 
regarded as normal, and agents would seek advantage by contrarian trading, whereas large 
\A\ would be regarded as anomalous, prompting panic-driven trend-following. 

In this paper we first develop the theory for MG-type models with arbitrary valuation 
update functions -F[j4]. Then we focus on the above three agent behaviour scenarios: a 
model of strict contrarians with controlled degrees of caution versus greed, one where non- 
volatile markets are interpreted as risk free and prompt trend-following (agents only become 
contrarians under volatile conditions), and one where in non- volatile markets agents are 
contrarians (switching to panic-driven trend-following under volatile conditions). Although 
the latter two cases are mathematically similar, they lead to qualitatively different solutions. 
We will find that certain regions of the phase diagram are characterized by prominent 
remanence effects, with multiple locally stable states, prompting us to rely on approximations 
of the Maxwell-construction type. As a result, whereas our predictions are confirmed 
satisfactorily by numerical simulations in non-remanent cases, when there is remanence, there 
remain deviations and gaps in our understanding which will require further investigation. 

2. Definitions 

Let there to be A*' agents in the game, labeled by i G {1, . . . , N}, where A'' is odd. The game 
proceeds at discrete steps t = 0, 1, 2, . . .. At every step t each agent takes a binary decision 
bi{t) € {—1,1}, the 'bid', representing e.g. buying ( — 1) versus selling (-1-1). A re-scaled 
aggregate overall bid at step t is defined as A{t) = N~^^^ X/i-i ^ii'^) + ^e(i), where Ae{t) is 
an external contribution, representing perturbations, the impact of large market operators, 
or the action of regulators. At each step, the agents are provided with external information, 
which in fake history MGs is a random number fi{t) £ {1, . . . ,p}. Each agent i has two 
strategies Ria, with a = 1, 2, with which to map each /i to a trading action: 



A strategy functions as a lookup-table with p entries, all of which are drawn independently 
at random from { — 1, 1} (with equal probabilities) before the start of the game. If agent i 
uses strategy a at step t, then he will act (deterministically) according to bi{t) = R'^^^ ■ 

In the standard MG an agent makes profit if he finds himself in the minority, i.e. if 
A{t)bi(t) < 0. Each agent monitors the performance of his two strategies (irrespective 
of whether they were used), by measuring the so-called valuations Piait), defined via 
Piait + 1) = Pia{t) — fjA{t) -Rf^^''. Here 77 > denotes a 'learning rate'. At each step t of 
the game, each agent i will select his best strategy ai{t) at that stage of the process, defined 
as ai{t) — arg maXag{i,2}{Pia(t)}. Agents thus behave as 'contrarians'. Here we generalize 
this rule in the spirit of [TT], to incorporate the possibility that whether agents behave as 
contrarians or trend-followers may depend dynamically on whether they perceive the market 
state A{t) to be close to or far from its 'natural' value: Pia{t+1) = Pia{t) — fjR'^^'^'' F[A{t)], with 
F[— A] = — (to retain A = as the 'natural' value for the overall bid). In the 'batch' 
version of the above dynamics one replaces in the evolution equations for the valuations the 
randomly drawn information /i(t) by an average over {1, . . . ,p}. The result is 



R^" :{l,...,p}^{-l,l} 



p 




(1) 



JV 




(2) 
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We switch in the usual manner to new variables qi{t) — ^[pii{t) — Pi2(t)], Cm — ^i-^ti ~ ^^2)' 
^li — + -^^2)1 ^rid S7p = N~^^^ '^.Lu'j^ . We choose fj — 2, and add perturbations 

9i{t) in order to define response functions. We introduce decision noise by replacing 
sgn[qi{t)] a[qi{t), Zi{t)], in which the {zj{t)} are independent and zero average Gaussian 
random numbers (the standard examples are additive and multiplicative noise definitions, 
corresponding to a[q, z] = sgn[q + Tz] and a[q, z] = sgn[(j'] sgn[l + Tz]). This leaves us with 

p 

q^{t + l) = q.{t) + e,{t) -^Y. ^^FiMt)] (3) 

JV 

A,{t) =AAt) + Q, + 4^J2^^a[q,it),z,(t)] (4) 



N 

i=i 

One obtains the standard batch MG for F[A] = A, and a batch majority game for F[A] = — A. 
We will develop the theory initially for arbitrary -^[A], but focus ultimately on the choices 

F\A\ = sgn(A)|^r, F\A\ = tA{\~ A^/AI] (5) 
with r = ±1 and Aq > 0. In the second formula, for r = —1 the agents behave as a trend- 
followers (majority game play) when \A\ < Aq, but switch to contrarians (minority game 
play) for \A\ > Aq; this is the model of [111112) . For r = 1 the situation is reversed. 

We will write averaging over the stochastic process Q as (...). The global bid 
fiuctuations in the system are characterized by the volatility matrix Ht^/: 

p p p 

f-L—l f—l — 1 

From this follows the conventional market volatility a via = limT->oo X/t-i 
3. Generating functional analysis 

The appropriate moment generating functional for a stochastic process of the type (|3]), given 
that now we will be interested also in overall bid statistics, is 



with A^{t) as defined in Q. For ([7]) to be well defined, we specify an upper time limit tmax- 
Taking suitable derivatives of the (0 with respect to the variables {'i/)i(f), 0,i(t)} generates 
all moments of the random variables {a[qi{t), Zi{t)]} and {Af_i{t)}, at arbitrary times, e.g. 

i.Mt)Mt)HqAt')Mt')]) ^ -^i^-^^^lll^ (9) 

{A'^Ht),zm = (10) 

(A'*[q(t),z(t)]Alq(i'),z(0])= -i liiTi jJ.ltl'^L (11) 

2 V,0^O a(p^(t)d(l)„{t') 

Averaging ([7]) over the disorder (the strategies) allows us to obtain from (I8I9I10I11[) 
expressions for disorder-averaged observables, such as correlation and response functions: 
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3.1. Evaluation of the disorder average 

We write in the usual way as an integral over all possible values of the qi{t) and the j4,j(t) 
at all times, and insert 5- functions to select the solution of (|3}, followed by averaging over 
the noise z — {zi{t)}. With the short-hand Si{t) = cr[qi{t), Zi{t)] we obtain: 



dA^{t)dA^{t) jA^(t)lA^(t)-A,(t)]+is/24,,,(t)A^(t) 

IJ,t 



it 



The disorder variables appear only in the last line, so 

(15) 



IJ,t 



X{ I P0(CI(0))\ I I dqi(t)dqi(t) ^ij^(t)fe(t+l)-<;,(t)-fl,(t)l+i^i(t)si(t)' 



)(q(o))[n' 



with 



= = J^g^ X]t"f(-^l"-^2)<3i(t)F[A^{t)]-iA^(t)[fli+JJ2 + (fli--R2)si{t)]} 

ijj. 

= ]Jo"^I^«' W'*''<'')-Ett' L^^,F[A^(t)]F[A^{t')]-iJ2tt, C,,,A^{t)A^(t') 

X eS«' '(tfA^.(t)F[A^(t')] + 0(N-^) ^^g^ 

where we introduced the temporary abbreviations 

i i i 

We isolate these as usual by inserting appropriate 5-functions (in integral representation, 
which generates conjugate integration variables), and define the short-hands DC — 
Y[ffr[d-Ctt' /V^n] and VA = ]^^[d^(t)/-\/27r] (with similar definitions for the other kernels 
and functions). Substitution into Z[tp,(j>\, followed by re-arranging terms, then leads us to 

Z[il),<i>\ = j [VCVC][VKVK][VLVL] ^^''Y.tt^^tt'0,,.+k,,,K,,,+L,,,L,,,]+o(io^(N)) 
X ( y'oqOqpo(q(0)) e'E.. ^-Wl^^C+D-'-W-^-Wl+iE., ^-W^'W 

/ Z 

J]^ JVAVA e'St [Mt)lA(t)-A,{t)]+iV24>^.{t)A(t)]~^J2tt,^'^*^^^ + '^tt']Mt') 



X 



X e"S"' Ltt'FWt)]FlA(t')]+J2^^, K„,A(t)F[A(t')l ^^^^ 

Upon assuming simple initial conditions of the form po(q) ~ YiiP^^^I^^ then arrive at 

Z[i(>,(t>] = /[OCOC][Ci^riJ?][MriL] e'^l*+*+"l+°''°'5''^» (18) 
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^ = iJ2i^tt'Cu' + Ku'Ktt' + Ltt'Lu'] (19) 



tt' 



$ ^ 1 ^ log / VAVA e'S* [A(t)[A(t)-Aat)]+iv^0,(t)A(t)] ^20) 



with 



N . 

M 

X e"' Stt' ^(*)ll+C'tt'l'*(t')-X;„/ -Ltt'f'[A(t)]F[A(t')l+^^^, if^,,A(t)F[A(t')] 

f^ = ^^log( y"©gOg Po(g(0)) 

X giI]tl'j(*)l9(* + l)-9(t)-ei(t)l+'/'i(0<^[<7(t),^(t)ll-iX;„/ ■J(<)itt'9('') 

/ z 

The C'(log(A^)) term in the exponent of (|18|) is independent of 0^(t), s-nd the 

external bid Ae{£) and the introduced valuation update function F[A] appear only in $. 

3. 2. Saddle-point equations and interpretation of order parameters 

The disorder-averaged functional (|18|l is evaluated by steepest descent integration, leading 
to coupled equations from which to solve the dynamic order parameters {C, C, K, K, L, L}: 

Cu' ^{a[q{t),z{t)]a[q{t'),z{t')]). (22) 
Ku' ^{cT[q{t),z{t)]q{t')). (23) 
Lu' = { q{tW) }* (24) 

The notation {...)* in the above expressions is a short-hand for 

, . 1 ^ JVqVq {M,[{q,q,z}]g[{q,q,z}]), 

{g[{q,q,z}]), ^ nn -j^ 2^ r„ . (26) 

jv^oo N ^ jT>qVq {Mi[{q,q,z}])^ 

M,[{q,q,z}] ^po(g(0))e'E*^W[«(*+i)-«W-«-(*)l+iE.*"W-W').-Wl 

X e~'S«'-^«''*"^<''' (27) 

Since the bid contribution Ae{t) appears only in one can take over standard results from 
the theory of batch MGs with regard to interpretation and simplification of order parameters 
(see e.g. [8]). Using the normalization identity lim.^ (j)^0 ■^[V'l </>] = 1 we find 

Cu' = lim {a[qit),z{t)]a[q{t'),z{t')]), (28) 

Gu'^-i lim {a[q{t),z{t)]q{t')). (29) 

= - lim {qmit'))* (30) 

These expressions (|28I29I30|I are to be evaluated at the physical saddle-point of ^' + + <1>. 
We conclude from ((29ll and ((30|, in combination with (|23I24|) that for all {t,t') 

K,,,=iGu', Lu'=0 (31) 
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We now send the fields {i/'ij'/'n} to zero, and choose the {6i} to be independent of i. The 
measure Mi[{g,(?,z}] then loses its dependence on i, and equations (I22I23I24I25|I simplify to 

Cw ={a[q{t),zit)]a[q{t'),z{t')]), (32) 
Gtt, = -i{c7[q{t),z{t)]q{t')}, (33) 

C'tt' = lim 757^, Ktt' = hm ttt^, ^tt' = lim — (34) 

with 

JOgOg (M[{g,g,z}])^ 
M[{g, g, z]] = po(g(0)) e'E* «W[.(*+i)-.W-^'W]-iE„. ^«'«(*)^(*') 

5.5. Evaluation of ^ 

We turn our attention to the function $ H20p . which, according to (|34|) . we only need to know 
for small L. We define the matrices I and D, with entries Itt' = <5tt' and Dui — 1 + Cu', and 
the short-hands A = {A(t)}, Ae = {Ae{t)} and F[A] = {F[A(t)]}. This allows us to write 

$ = 1 ^ log y dAd^ P(|)5[A - Ae + GF[A] - 
/J 

X e'^St ''>A'(*)'4(*)-Ett' itt'-F[-4(t)lf'['4(t')l ^37) 

with 

P(0 = 2i(i^c-eo-^ (38) 
yditlTD] 

At the saddle-point, G must obey causality, so we can interpret the above expression in terms 
of an effective stochastic process for the bid, with a zero average Gaussian noise field ^(i): 

A{t) = A4t) - J2 Gu'FlA{t')] + m (39) 
t'<t 

m) = 0, mm) = ^ a.- (40) 

The situation is clearly reminiscent of real history MGs |9], although the equations are 
simpler. From now on we write averages over (|39I40|I simply as {...). We also define 

-l-o = a log J dAd{ P{i)S[A - Ae + GF[A] - |] (41) 

At the saddle-point we have $o = 0. We expand $ for small L and small 0: 

* = Ko + ^ ^ Mt){A{t)) - Q ^ Lu'{F[A{t)]F[A{t')]) 

fit tt' 

- ^ E Mt)MmA{t)A{t')) - {A{t)){A{t'))] + 0(4;\L^) (42) 

Clearly, lim^^Q "I> = $o, and $o depends on G only, not on C or L. From our expansion 
of "1? we can extract all the quantities we are interested in. We only have to be careful that 
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causality can only be assumed after the diflterentiations: 

= lim ^ = (45) 

L^O O-Ltt' 

We define the bid response function Rffi = d{F[A{t)]) /dAe{t') and the bid covariance 
function Eu' = 2(F[A(i)]F[yl(t')]) , so Ku' = -Q-Rft and Lu' = -|iQEtt'- Causality 
ensures that Rffi = for t < t', and _Rtt — 1. We can also calculate bid statistics: 



iA^Ht)Mt)WHt')Mt')]) = -^^li- „^|||§y - iMt)A(t')} (47) 

5.^. T/ie effective single agent equation 

The above results lead to a further simplification of our saddle-point equations (|32l33l34p : 

Cu' ={a[q{t),z(t)]a[q{t'),z(t')]). (48) 

Gu' = -i{a[q(t),z{t)]q(t')}. (49) 

with 

, ,f . /PgPg {A4l{q,q,z}]g[{q,q,z}]), 

{gl{q, q, z}])^ = — (50) 

JVqVq {M[{q,q,z}])^ 

M[{q,q,z}] =po(g(0))e'I^t''*''^'*+''-'<*'~''"+°St'^"'"'''<*'''""'^"~^°I^«''<*'^«''<''' 

(51) 

We eliminate the {q{t)} by exploiting causality: the term Rttia[q{t'), z{t')] in (|5ip 
involves only values of q{t') with t' < t. This allows us to calculate the denominator of 
the fraction (|50|) by integrating out the variables {q{t)} iteratively, first over g(imax) (which 
gives us (5[g(tmax — 1)]), followed by integration over g(tmax — 1), etc. The result is simply 



VqVq M[{q,q,z}]^ j dg(0) po(g(0)) = 1 (52) 
This, in turn, implies that 

{a[q{t),z{t)]q{t')). = i^^{a[qit),z{t)]). 
We do the remaining integrals over {q}, and write our equations in the simpler form 

Cw = {a[q{t),z{t)Hq{t'),z{t')]}. Gw = ^^"''ff;^^^^* (53) 

with {9[{q,z}]). = MtMt)] {M[{q,z}]g[{q,z}]). and 

-d77(t)le-il^«'''«'^"'>«"'(*'' 



M 



:R4]^Po(.(o))/n[^ 



VdetE 



Yl S [q{t + 1) - q{t) - e(t) + a ^ Rw <tW ) , z{t')] ~ ^y{t) 



X 

t>0 



(54) 
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We recognize that (|54p is the measure corresponding to a single-agent process of the form 

q{t + 1) = q{t) + 9{t) -aJ2 Rtt'oW), z{t')] + r,{t) (55) 



t'<t 



in which ri{t) is a zero-mean Gaussian noise, with temporal correlations {ri{t)g(t')) = "Eu 
The two kernels E and R are to be calculated from 

d 



Rw = Q^^iFlMm, = 2{F[A{t)]F[A{t')]) (56) 



where the averages refer to the process (139140 |l . The correlation and response functions 
H12ll3p . the order parameters of our problem, are to be solved from (|53|) . in which {. . now 
denotes averaging over (|55|l and the zero-average Gaussian noise {z{t)}, with {z{t)z{t')) = 
Stt' ■ These results represent a fully exact and closed theory for N ^ oo. 

As a simple test we could go back to the standard MG. If we choose F[A] = A, the 
effective bid process (|39I40|I becomes linear, and is solved easily: 

Ait)=J2(^ + G)-}[A,{t')+at')] (57) 
t' 

so that we can calculate the kernels E and R explicitly: 

= d^)^^^'^^ ^ d£{F) + G)7s'A4s) = {1 + G)-} (58) 



E«, = 2{A{t)A{t')) =2^(1 + G)Z\I + G);,l,{[A4s) + e(.)][Ae(s') + ?(.')]) 



^[{l + Gr^D[A,]{l + G^)-%t' (59) 
with D[Ae]tt' ~ 2Ae{t)Ae{t') + 1 + Gtt'- One confirms readily that this is the correct solution. 

4. Ergodic stationary states for Ae{t) — 

We now take Ae{t) = Ae for all t. In time-translation invariant stationary states without 
long-term memory one has Gu' ~ G{t — t'), Gu' = G{t — t'), Et^/ = E(t — t'), and 
Rtt' = R{t — t'); all three operators {C, G, E} and their powers commute. We try to calculate 
the four persistent order parameters, x ~ X/t>o'-^(^)' ~ X/t>o^(^)' ~ limt^txi C(f), 
and = limt_.oo E(t), from the closed equations (I53I56|I . We assume a stationary state 
without anomalous response, i.e. both x a-nd Xr finite numbers. From now on we will 
use the the following notation for time averages: x = limr^txi X/t=i ^{t)- Much of the 
analysis is standard, and we will where appropriate skip those details that are familiar. 

4.I. Equations for persistent order parameters - the effective agent process 

We define q = limt^oo q{t) /t, assuming that this limit exists, and send t c» in the 
integrated version of (|55[) . The result is 

q = y/arj + e - axj^ (60) 

Here a = limT^oo X/t<T / ""[^^i A ^^i^ = (27r)~'^/'^e~^ I^Az. Given the properties 
of (7[g], in cases where g 5^ we must have ct — sgn[(j].(j[oo]; for g = we know that < a [00]. 
We inspect the possible solutions 'fickle' (g = 0) versus 'frozen' (g 7^ 0), noting that in both 
cases we must have sgn[Xj;CT] = sgn[r7v^ -f Q\. For the fickle solution the situations is clear: 

'fickle': , = ^ ^ exists if ^ Q\ < a\(xy\\Xr,\<^ (61) 

For the frozen solution we must distinguish between the cases Xr > versus Xr < 0, 
representing negative versus positive feedback in the effective agent equation: 
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• X« > 0: 

Here, due to the absence of positive feedback in the system, we can write directly 

|?7\/q + ^1 > <^[oo]Xr'^ • 'frozen' solution, a — a[oo] sgn[r;\/a + 0] (62) 
\ri^/a + ^1 < a[oo]XfiO: : 'fickle' solution, a = [y/a rj + ^]/q;Xk (63) 

• X„ < 0: 

As was found earlier in other MG versions with positive feedback, the effective agent 
equation now allows for rcmancncc effects, leading to the potential for multiple solutions: 

/a + 9\ > a[oo]\xji\(-t ■ 'frozen' solution, a = ufcx)] sgn[T]\/a + 6] (64) 

'frozen' solutions, a = ±cr[oo] , , 

'fickle' solution, a = [^/arj + 6]/aXa 

For \fj^/a + 0\ < a[(x]\xjf \a there arc two stable solutions a = ±cr[cx)] separated by the 
unstable 'fickle' one. The two branches a = —a[oo] sgn[r?v^ + &] in this region must be 
remanent ones, and the Maxwell construction tells us to choose in the stationary state 

Xr < : 'frozen' solution, a = cr[oo] sgn[r}^/a + 9] (66) 



\r]Va + e\ < ct[oo]|xr|q; 



The variance of 77 is simply equal to Sq, since 

T 

(t) = lim ^ y = hm E(t) = 



(67) 



We can now calculate equations for the persistent order parameters, sending ^ — > as soon 
as possible. As before we have to distinguish between Xk > and Xr < 0: 

• Xr > 0: 

The persistent correlations follow from c = (o"^)*: 



J drj Piv) 1^6 
axU 2 ^ 



XR(7[oo]v/a-|??| 



axi 



+ ( 



\v\-XR<^[<x>]Va cr^[c 



QX- I 2 ^ . /oC2 /o^q2 



/2Si 



n 



+ 2.^[oo]{i4Erf[^^.^]} 



The frozen fraction <f) and the susceptibility x are calculated similarly: 

rXRO-[oo]Va 



/ 



dr] P{r])e |r7|-XB0-[oo]Va 



1 - Erf 



S0V2 



' 89 olXr S0V2 



In terms of the usual short-hand v = XrO"[cx)] y^/SoV^, we then arrive at 



(68) 

(69) 
(70) 

(71) 



<j, = l- Erf [u] (72) 
X = Erf H/axR (73) 

Xr <0: 

This situation is simpler: one has c = (W^)* = it^(oo), and (j) = 1. The susceptibility x 
for 9 = becomes 

2o-[cxj] 



V = lim / dr? P(ri)-^a 
e^oj 89 



^2^ 



(74) 
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If < the system is fully frozen, and nothing further happens. To close our persistent 
order parameter equations for c and if Xr > 0, we need the ratio Xr/So', to get also x 
we need Xr a-nd Sq. We now take As{t) = A^, and define the asymptotic time averages 
A = limr^oo X/t<T ^(^) ^'^'I ^ ~ liniT--.oo X/t<T -^[^(*)]- This allows us to write 

XR^d(F)/dA,, So = 2(7?') (75) 

4-2. Analysis of the effective overall bid process 

Closing our stationary state equations requires extracting the values of Xr and So from the 
effective process (139140 |l for the overall bids. We separate in the bid noise ^(t) and the bids 
A{t) the persistent from the non-persistent terms: 



A{t)^A + A{t), C(i) = ^y^(l + c)+C(i) (76) 

Here z is a zero-average unit- variance frozen Gaussian variable, and £^(t) is also a zero-average 
Gaussian variable, uncorrelated with z and with covariances {^{t)^{t')) = ^C{t — t'). Here 
C(t) = C{t) — c. Our bid process (|39|) now becomes 



A = A,-xF + z^^il + c) (77) 
Mt) = m - J2 + Mt " s)] - f} (78) 

s>0 

The two quantities A and F are both parametrized by z, so we write A{z) and F{z). Also 
the non-persistent bid parts A{t) depend on z since A occurs in (|78p . so we write A{t, z). Our 
static objects Sq and Xr are known once we have F{z). In (ffT]) we have already one relation 
for the two objects, so we need one more equation connecting A{z) to F{z) to obtain closed 
formulae. To get this second relation we work out F{z): 

F{z)= I AAW{A\z)F\A{z)+A], W{a\z) ^ M-m 5\a-A{t,z)] (79) 

/ T^OO T 

So far our analysis is direct and fully exact. What is left is to find the statistics W^(a|z) of 
the non-frozen bid contributions, which requires ansatze. 

To calculate VF(a|2) we assume the response function G to decay much more slowly 
than the times over which the A{t, z) are correlated, so that to the time summation in (|78|) 
we can apply the central limit theorem. This tells us that also the A{t, z) must be zero- 
average Gaussian. Let us define the covariance matrix E,tt'{z) = {A{t, z)A{t' , z)} , it must be 
time-translation invariant, so we write H(t, z) = Ss+t,siz). In [Appendix A| we show that 

E{t,z) = ^Cit) + 0{Tc/rG) (80) 

If, as in earlier MG analyses [S], we can rely on lim]v^oo tc /tq ~ in the ergodic regime 
(this will be our present ansatz) then we have simply E{t,z) = ^C{t), and in particular 
E(0, z) — i(l — c), which closes our equations: 



A{z)=A.~xF{z) + z^^{l+c), Fiz)^ J Dx F[A{z) + x^^{l-c)] (81) 

with the shorthand Dx = (27r)"^''^e"''^''^d2;. We eliminate A(z) and get F{z) = f{z,Ae), 
where f{z, Ae) is the solution of the fixed-point equation 



/ = Dx F 



Ae-Xf + Z\llii+c)+xJ^{l-c) 



(82) 
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The shows that F{z) = ^{Ae + z^J\(\ + c)), where $(u) is to be solved from 
= Dx F 



u-x^{u)+x\l -{1-c) 



(83) 



Clearly $(m) is anti-symmetric, since F[A] is anti-symmetric. Finally, we will solve the 
nonlinear functional equation (|83|) . To do this we define a new function A{z) via the identity 
$(u) = [u — A~^(u)]/x, insertion into (|83|) of which gives after some rewriting 



A{z) ^ z + x Dx F 



(84) 



Equation (|84p is explicit, but shows that in the case of positive feedback (as for the majority 
game, corresponding to F[A] = —A) there is again the possibility of multiple solutions, 
which would here take the form of non-invertibility of the function A{z). Non-invertibility is 
signaled by finding A'{z) — for finite z, i.e. by 



1 + 



XV2 



Dx xF 



z + x\l -(1-c) 



= 



(85) 



4-3. Equations for Xr o,nd So - closure of the stationary state theory 
Given the solution of (|83p. we obtain closure of our stationary state equations: 

V2 



Xr = 



Dz 2$ 



{A.+z^i^)) 



si =2 J Dz $'(4, + ^y^(l + c)) 



(86) 



(87) 



When expressing these equations in terms of the function A ^ (z) (which is parametrized by 
c and x) find that both are expressed in terms of the following Gaussian integrals: 



I0{C,X)= Jdz A-^(Ae+2-^i(l+c)) 

Ji(c,x)= Jdz zA-^(^A,+z^^(1 + c) 



h{c,x) = / Dz 



+ 



(89) 



(90) 



We note that the validity of the last step depends crucially on non-invertibility issues being 
absent or resolved. Substitution of (|84p into (|86I87|I . followed by re-arrangements, gives 

^/2 



2 2 
So ~ 

X 



1 - 



h{c,x) 



At 



2AJo{c, x) + 2 + + He, X) - v/2(l + c)/i(c, x) 



(91) 
(92) 



For Ae = G one has /o(c, x) = and the above integrals simplify. The equations (|91l92p are 
to be solved in combination with (|71I73P for c and x- If this results in Xr > 0, the problem is 
solved and the observable (j) follows from (|72|) . As soon as Xh < 0, we enter the fully frozen 
state c = (/) = 1 induced by positive feedback in the valuation dynamics. From (|8ip we can 
also extract an expression for a static overall bid susceptibility xa{z) — dA(z)/dAe. 
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4-4- Simple model examples 

At this stage it is appropriate to inspect specific choices for to serve as tests. We set 

= for simplicity; the external bids were needed to calculate the overall bid susceptibility 
Xn, but are no longer essential. 

• F[A] = A, the standard Minority Game: 

Here A{z) = z{1+x)j so A~^{z) — z/{l+x) ^-nd the Gaussian integrals Ii{c,x) become 

/o(c,x) = o, i,ic,x) = ^^y ^^(^'^) = 2(TTiF ^''^ 

This then reproduces the correct relations 

Xn = 1/(1+X), So = VT+~c/{l+x) (94) 

The onset of non-invertibility is according to (|85|l marked by 1 + x = (which never 
happens in the ergodic phase of the standard MG, where x ^ 0)- Since always Xh > 
we never enter the fully frozen (remanent) state obtained via the Maxwell construction. 

• F[A] = —A, the standard Majority Game: 

Here A(z) = 2:(1— x), so A~^{z) — z/{l — x) a-nd the Gaussian integrals Ie{c,x) become 

/o(c,x)=0, /i(c,x) = -^^^, ^2(c,x)= 2(T3^ (9^) 
The result for Xn ^nd So is 

Xh = 1/(x-1), So = VU^/\x-^\ (96) 

If Xi, > (no remanence) one extracts from (I73p and (|96|) that x ~ Erf(«)/[Erf(i')— q], so 
for a < 1 we can be sure that x < a-nd run into the contradiction Xr < 0. Apparently, 
the general scenario is that where Xb < and the system is in the fully frozen remanent 
state. Hence X < and its value is given by formula (|74p. which reduces to 



X ^ 



v/2^a(l+c) 



Z(t[ooJ 

The condition for leaving the frozen remanent state, viz. x = li is seen to coincide with 
the condition for having non-invertibility for the overall bid process, but this condition 
will clearly never be met; the system is always in the fully frozen remanent state. 

5. Applications - greedy versus cautious contrarians 

We now apply our theory to specific choices for the function all corresponding to models 

that so far could only be studied via numerical simulations. For simplicity we choose Ae — 0. 

5.1. Preparation 

Due to Ae = 0, the equations (|91l92p that close our equations for persistent order parameters 
simplify to 

XX« =l-V2 h{c,x)/VU^ (98) 



1x1^0 = Y^l + c + 2/2 (c, x) - 2^2(l + cjh{c, x) (99) 



with 

r . R r r . fi -|2 

- (100) 



A-'{z\j^{l+c)) 



h{c,x) = Jdz zA'\z^^{1 + c)), l2{c,x) = Jdz 
and with A{z) as given in (|84|l . It will prove efficient to define the function 

{1 — 9?!^ 1 2 "1 
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Combining our relations so far then allows us to conclude that ergodic solutions with Xr > 
follow from solving the following two coupled equations for the basic unknowns {v,x), after 
which the order parameters (j) and c follow via 0=1 — Erf (w) and c = c{v) (so always v > 0): 



l/ErfR , ^ f 1 + c{v) + 2h{c{v),x) - 2^2il + c{v))h{c{v), x) \ t 

= sgn x)<^ , > (102) 

(103) 



vy/2[l + civ)] ^ I + civ) - y/2[l + civ)]hic(v),x) 

EtHv 



l~V2h{civ),x)/^/T+4^ 
Only X > is possible, so we are allowed to introduce a further function U{v) > 0, 
^ a^[oo]Erf(.) 

^ ' 2[l + c{v)]v^ ^ ' 

and compactify our equations for {v,x), describing solutions with x > s^^id Xn > 0, to 

1 I l2{c{v).x) _ o Il{c{v),x) 

r„ . V[i+c(.)]/2 Erf(t;) 



One proves from the definitions of /i,2(c, x) that always /2(c, x) > 2j/i(c, x)l ^/[l + c(«)]/2, 
so the numerator of the first of our compact equations is always nonnegative. To have a 
solution with Xh > we must demand that the denominator is also positive. 

In contrast, in states with X/j < one has c = (t^(oo), (p = 1 i.e. the system is always 
fully frozen. Here the only order parameter left to be calculated is x, which follows from 



2-M , ^(^^oo).x) . /.(a-(oo),x) (106) 



^2na[l + o-^(oo)] Y [l + (j2(oo)]/2 ^[l + a2(oo)]/2 

Again only x > is possible (which we may rely upon in the rest of this paper), hence 



7ra[l + a2(cx))] [l + a2(cx))]/2 ^[l + <j2(oo)]/2 

To confirm that indeed Xj; < we must verify the outcome of 



_ -1 



1- =Ji('^'(°Q).x) 
^l + cr2(oo) 



(108) 



5.^. Invertible overall bid impact functions 



Here we focus on those models, which includes the original MG, in which F[A\ is 
monotonically increasing. The ansatz x > now guarantees that A(«) is invertible. These 
models have a remarkable universality property: all exhibit an ergodicity-breaking transition, 
marked by x ^ oo, exactly at the value Uc of the standard minority game, irrespective of 
the precise form of the function To demonstrate this we first rewrite 



X 

From this we conclude that, for all 2: G IR, 



^ _ fDxF[A'\u) + xJ^{l~c)] (109) 



lim Dx F\A-'^{z)+x\ -{1-c)] 



(110) 



Since F[A] is monotonic, the obvious solution A^^(2:) — (guaranteed by the anti-symmetry 
of -F[A]) must be unique, and hence we know that generally limx—oo A~^(2:) = 0. It now 
follows that limx-*oo /i(c, x) = fimx-»cx) ^2(0, x) ~ 0, and therefore via (|98I99|) we find 

lim XXjj = 1, lim Ixl-S'o = Vl + c, fim — = sgn(x„)Vl+c (111) 

X^oo X^oo X— *tx) Xe 
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Figure 1. Simulation results for the volatility cr of MG-type models with 
F[A] = sgn[A]|yl|T, for 7 = 0,1,2,3. Vertical dashed line: predicted location of 
the X ^ 00 transition. Empty/full markers correspond to biased/unbiased initial 
conditions. The location of the phase transition seems indeed independent of 7. 
Even for a > ac the volatility appears only weakly dependent upon the greed 
exponent 7. However, for values of 7 > 4 (excessive agent greed) the ergodic 
region is destroyed and the efficient phase of the market vanishes (see fig |4jl . 





Figure 2. Simulation results for the fraction of frozen agents </> and correlations 
c for MG-type models with F[A] = sgn[A]\A\^ , for 7 = 0, 1, 2, 3. Vertical dashed 
line: predicted location of the x — > 00 transition. Empty/full markers correspond 
to biased/unbiased initial conditions. As observed for the volatility, also ip and c 
appear to be only weakly dependent on 7 in the ergodic region a < ac- 



The ansatz x > guarantees sgn(Xj;) = 1 (with i as x ^ 00), and our persistent order 
parameter equations (|71I72I73|) close at the transition x ^ 00 exactly in the same way as 
they would for the conventional MG, i.e. 



4 



1 — 2?;^ 

1 + . etHv] 



a = Erf[w], 



V = CT 00 



V^/v/2(l + c) 



(112) 
(113) 
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Figure 3. Theory versus simulation results for MG-type models with F[A] = 
sgn[A] |j4|''', for 7 = 0,1,2,3. Observed versus predicted values of the persistent 
correlations c and the fraction of frozen agents {j>, for the ergodic regime. Lines: 
theoretical prediction; markers: simulation results. There is clearly excellent 
agreement between the theoretical predictions and the computer simulations. 



So aU systems with monotonically increasing anti-symmetric F[A] will, provided they have an 
ergodic regime, always exhibit a.x—'oo transition at the conventional MG value ac~ 0.3374, 
irrespective of the actual form of i^'f^]. 

Away from the transition one should expect a dependence of the values of the persistent 
order parameters on the choice made for However, for 'sensible' choices of F[A] one 

generally finds this dependence to be weak. To illustrate this we now focus on a particular 
class of models, with monotonic valuation update functions of the form 

F[A] ^ sgn[A]\A\'' , -y > (114) 

These models are relatively straightforward generalizations of the original MG (which 
corresponds to 7 = 1), nevertheless for 7 7^ 1 the standard solution route (i.e. generating 
functional analysis of the strategy selection process, without including the overall bid 
dynamics explicitly in the formalism), would not have worked. For 7 > 1 the agents with 
l|114p place more importance on making money by exploiting large fluctuations {\A\ > 1), so 
can be described as greedy high-risk contrarians, whereas for 7 < 1 they prefer to exploit 
small market fluctuations, and operate as cautious low-risk contrarians. 

We know from the above argument that their x ~* 00 ergodicity breaking transition 
point ftc will be identical to that of the standard MG. Let us now calculate the persistent 
order parameters in the ergodic region a > Oc- On physical grounds one does not expect a 
negative susceptibility and F[A] increases monotonically, hence A{z) will be invertible, and 
we can transform the integrals (|100|l via the substitution z = A{x)\/^/\/l + c, and find 

/r(c,x)= e-^^(^)/(^+^) (115) 



■'^2(c,x) = ^== / ^== e '^"'■^'xA{x) (116) 
'l + c J J2-K 



This removes the need for inversion of A (2). For the models (|114|l one then finds 
A(2:) ^ z + X Dx sgn 



2 + s^/i(l^ 



z + x^j^{l^ 



(117) 
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a 




Figure 4. Fraction of frozen agents (f> and volatility cr, measured in simulations 
of MG-type systems with F[A] = sgn[yl] | Ap, for 7 = 4,5. Dashed line: 
predicted location of the x ~> transition. Empty/full markers correspond 
to biased/unbiased initial conditions. For 7 > 4 we no longer appear to have the 
usual ergodic phase, and more extensive simulations with different durations and 
system sizes are required to determine the nature of the macroscopic state(s). 



For non-integer 7 the integral has to be calculated numerically. For integer 7 one finds 







7 = 3 




)]xErf 



+ 



(118) 
(119) 
(120) 
(121) 



Since on physical grounds one does not expect a negative susceptibility, invertibility is 
expected to hold and the present family of models should behave qualitatively as the ordinary 
MG. One also expects that as the susceptibility goes to zero for large alpha the behavior of 
the system should be almost independent of the value of 7. For 7 < 3 these predictions are 
borne out by numerical simulations (all carried out with — 4097, and measured during 1000 
steps after an 2000 steps equilibration period), as shown in figures [Till For large 7 (excessive 
agent greed), however, in spite of the agents still operating as contrarians, the ergodic phase 
appears to be destroyed by their increasing focus on big-gain big-risk decisions, and there is 
no longer an efficient market regime with low volatility. 
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6. Applications - dynamic switching between contrarian trading and 
trend following 

Next we inspect a class of models in which agents switch from trend-following to contrarian 
behaviour, dependent on the absolute value \A\ of the overall market bid. The rationale is 
to create more realistic agent behaviour, based on interpreting A as a measure of the price 
returns in the market. One example was proposed in [11], corresponding to F[A] = eA^ — A, 
with e > 0. This model, in which agents are trend-follows for \A\ < but contrarians for 

1^1 > l/\/e, can not be solved analytically using the standard generating functional analysis 
route. Here we generalize their model slightly, allowing also for the reverse tendency, where 
agents become trend-followers for large instead of small \ A\, and analyze the case 

FlAl^rAil-A^/Al), with r = ±1, Ao > (122) 

The model of [TT] corresponds to r = — 1 and Ao — 1/^/^- For r = 1, in contrast, agents 
behave as contrarians for modest deviations of the returns from their average value, but 
switch to herding when they perceive the market to be anomalous, i.e. for \A\ > Aq. For 
Ao — ^ oo, the model (|122p reduces either to the standard MG (for r = 1) or to a majority 
type game (for r = — 1); for Aq —> one anticipates the opposite. 



6.1. Non-invertible overall bid impact functions 
For (fT22l) one finds 



A{z)^z[l + x-^il^c)x/Al] -xz'/Al (123) 

where x = tX- Whether A{z) is invertible will depend on Aq. If Aq{1 + x~^) > |(1 — c), there 
will always be a region of non-invertibility, with three solutions z of the equation A(2:) — A. 
The latter are the roots of a cubic equation and can therefore be calculated analytically. 



z 



[A^(l + x)/x-:^(l-c)]+^=0 (124) 



Following 13 we write the cubic equation in the form z + 3qz — 2r = by defining 

g= i(l-c)-A'(l + x)/3x, r^^AlA/2x (125) 
We can then classify the solution(s) of the equation A{z) = A as follows: 



q^ + r^>0: one soln, z = [r + y^q^^ + r^]^^^ + [r - y^q^^ + r^]^/^ (126) 

3 2 i 1 r 
q +r <0: three solus, zi = 2|g| 2 cos(-arccos( — )) (127) 

3 \/\q\''^ 

Z2 = — jg] ^ cos(— arccos( — )) + Vs\q\ ^ sin(-arccos( — )) (128) 

i 1 r I — i 1 r 
23 ~ ~'\<f\ ^ cos(— arccos( — )) — v3|q| ^ sin(-arccos( — )) (129) 

Our solution must respect the symmetry A~^(— z) = — A^^(z), which translates into 
searching for a root with z{—r) = —z(r^. Inspection reveals that for -I- > the solution 
l|126p has the desired symmetry. For (f' -\- r^ < we find that 22(— J") = —Z2{r).^ and that 
Zi{—r) — —zi{r). Hence 0i,3(r) represent two 'extremal' solution branches (related to each 
other by inversion symmetry), and Z2{r) represents a middle branch. The region of multiple 
solutions is defined by |r| < |g|^^'^, where we have infinitely many options for assigning a 
value to A~^{z). The conventional one is the Maxwell construction, based on assuming 
the multiplicity of solutions to be caused by remanence. Here the middle branch Z2{r) is 
taken to be dynamically unstable, and one takes for < r < ig^^^ the continuation zi{r) 
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Figure 5. The options for constructing an anti-symmetric solution z(r) of the 
cubic equation + 3qz — 2r = for q < 0, shown as a function of r. Dashed: 
all solutions. Left: the Maxwell construction, which assumes the middle solution 
for |r| < to be unstable, and the others to reflect remanence. Right: the 

consequence of assuming the middle solution to be stable. Only the one on the 
right turns out to have the correct Aq — > oo limit (see main text). 



of the r > solution, and for — < r < the continuation Z3(r) of the r < — 

solution, with a discontinuity at r = 0. Our second option implies assuming the middle 
branch to be stable, i.e. choosing 2:2(7') for jrj < |g|'^''^. The two options are illustrated in 
figure [5l Assessing which of these choices (if any) is correct would in principle require a 
stability analysis of the asymptotic solution of the overall bid dynamics. 

Upon translating the above arguments into the language of A~^{z), the resulting picture 
is the following, where still q = i(l — c) — |^o(l+x)/x but now with r{z) — —^Aqz/x- 

q>0 or q<0, lr(2)l > lg|^''^ : A"'(2) = [r{z) + y^q'^ + r^{z)]^ + [r{z)- q^ +r'^{z)]^ 

(130) 

Here A(2) is fully invertible. In the alternative scenario we have the Maxwell option: 

g < 0, |r(2)| < : A~^(2) = 2 sgn[r(2)]|g| ^ cos(^arccos( ^^^ )) (131) 

But we also have the non-Maxwell solution, which can be rewritten as: 

g < 0, lr(2)|<|g|^''^ ; A"'(2) = -2|g| ^ sin(-!-arcsin(^l^)) (132) 

3 \/\q\'^ 

Only for Aq —* 00 can we decide between our candidate solutions for q < and \r{z)\ < \q\'^'''^ 
without analyzing dynamic stability in the underlying bid process. There (|122|l reduces to 
the standard MG for t — 1 and to the standard majority game for t — —1, both of which we 
analyzed in section \4A\ The correct solution must reproduce limAo-*oo A^^(2) = 2/(1 + x). 
For Ao 00, X ^ (~1)0), and finite z one has q < and \r{z)\ < \q\^^^ (in fact 
limAo-.oor(2)/|g|3/2 = Q), so we do indeed probe the region of ambiguity. Our test reveals, 
using \/3 sin(|arccos(a;)) — cos(iarccos(a::)) — — |a; + 0(2;'^), that for Ao 00: 

MaxweU soln : A"^(2) = ylo|l + Y''^sgn(2) -I- 0{Ao), incorrect (133) 
alternative soln : A"^ (2) = 2/(1 + x) + C(ylo ^), correct (134) 

For X G (~1)0) we have g > 0, so there is no ambiguity: A~^(2) is given by (I130p . which for 
Ao ^ CX3 reproduces correctly A~^(2) = 2/(1 -|- x) + 0{Aq^). Hence, for Ao ^ 00 the only 
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acceptable solution is (|13Ull32p 0. We resolve the remaining ambiguity as follows: since the 
pure majority and minority games always exhibit limz^o ^^~^{^) > 0, we take this property 
to hold generally. This means that for weak random bids the effect of agent interaction is to 
push these bids back to zero (contrarian action) or to amplify them (trend- following) , but 
there is no change of sign. For r — —1 we now have either |(1 — c)/Aq > 1 — ^nd the 
unambiguous solution (|130|l . or we have ^{1 — c)/Aq < 1 — x~ ^nd the Maxwell option (llSlf) . 
For r = 1 we must always demand |(1 — c)/Aq < 1 + x~^ and the non-Maxwell option (|132|l . 



6.2. Conventional x — > oo transitions 

We can now calculate transition lines. In the present model we can have a traditional x ^ co 
transition, a transition where Xr changes sign (switching from a minority to a majority-type 
game), and a transition marking the emergence of jumps in A~^{z). We start with the 
calculation of the x —* co transitions. 

For r = 1, X — ^ CO and finite z one has r{z) = 0{x^^) and q — i(l— c) — ^Aq + 0{xr^)y 
from which it follows that if lim^-joo §(1 — c) ^ Aq then 



A-\z) 



+ o{x-') 



(135) 



From this one extracts lim^^^cxj /i(c, x) ~ lim^^-^oo -^^2(0, x) = 0, and via the same arguments 
that applied to models with invertible bid impact functions one is led to 



lim XXr = 1, 



lim x^o = 

X— >oo 



So 



lim — = sgn(xR)Vl + c 



(136) 



If Xr > 0, our equations (|71I72I73|) close for x — * 00 exactly as they would for the conventional 
MG, with the standard x ~* °o transition at the value Oc ~ 0.3374. If Xr < 0, on 
the other hand, no x — * 00 transition is possible. Taking into account the requirement 
lim^^o ^^^^(2) > implies that for t — 1 the x ^ 00 transition exists only if Aq > |(l — c). 
Here g < and r{z) = 0{x~^), so we are in the remanent region. 

For T — —1, X ^ 00 and finite 2 one still has r{z) — 0{x~^) and q — ^(1- 

|(l-c) / Aq then for g < we wiU have \r(z)\ < \q\^^^. Hence 

3- ^ A-(.) = 



0{x ). So if limx^ 



Ag<^(l- 



-(i-c)M^-i 



c) : A ^{z) — sgn(z) 



^{l-c)+0{x~') 



(137) 



(138) 



If Aq < |(1— c) we return as expected to the conventional MG transition line at Oc ~ 0.3374; 
however, in contrast to r = 1 this line is now in the non-remanent region. If Aq > |(1 — c), 
on the other hand, the x ~* 00 line will be in the remanent region. With some foresight we 
now write Aq — |(1 — c) + i(l+c)H^ with H > 0, and obtain 



/i(c,x) = h/^" 



+ 0(X" 



^2(c,x) = ;^(1 + c)hVO(x-') (139) 



which leads to 



U{v) 



1 = 



1 - H^2/7r 
Upon solving the first equation for H, 

1 



a = Erf(u)/[1 - ; 



±iv) = -^\2^U{v) ± .y[2^U{v)]^ + 2t:[U{v)-1]\ 



(140) 



(141) 



t It is surprising that in this problem the Maxwell construction is not always the correct way to handle 
the multiplicity of solutions, given its track record in physical many-particle systems. However, 
minority games do not obey detailed balance, so intuition developed on the basis of bifurcation 
analyses obtained via free energy minimization in equilibrium systems may be misleading. 
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we then arrive at a convenient parametrization of the transition line in the {a,Ao) plane, 
with u > as a parameter. The line turns out to have two branches (indicated by ±): 



aHv) = y f [1 - + + (142) 

a±{v) =Et{{v)/[1 -E±{v)^/2/^] (143) 

We must demand < E±{v) < ^JVl2, to guarantee Xr > 0, and [2~U{v)]'^ + 2tt[U{v)-1] > 0, 
to ensure E±{v) G IR. We have now found the x ~* transition line for both Aq < ^{1 — c) 
(in the non-remanent region, where it is independent of Ao), and for |(1 — c) < Aq < 
1(1— c) + |7r(l+c) (in the remanent region, where it depends on ^o)- At the moment where 
Aq = |(1 — c) + ^7r(l + c), the bid susceptibility Xb goes through zero, marking a switch to 
majority game behavior; we find below that this occurs for the + branch at i; = 0. 

To aid and test numerical evaluation it will be helpful to assess the limits ?; ^ 
and i; ^ 00 of the above parametrized branches. For small v one finds, using Erf(-i;) = 
{2v / ^/tv)[1 — ^v^ + 0(11*)] and the fact that H(u) cannot be negative, 

= - + oiv^) (145) 

V -i 2cr^[ooJV2 

Hence 



hm A+(t;) = ^^[1 - a^M] + J[l + a^H] (146) 

lima+(«)=-^ (147) 

V-.0 +^ ^ [l + cr2[oo]]7r(7r-2) ^ ^ 

For a[oo] = 1 (no decision noise) this gives limv~to a+{v) — 2/7r(7r — 2) ~ 0.5577 and 
lim„_o^J(«) = -sfiiTiK. 1.2533. For V 00, in contrast, we observe due to lim„^oo U{v) = 
that the H±(i;) are no longer real- valued; both branches terminate and meet at the value 
■^max such that [[/(fmax) — 2]^ = 27r[l — (7(t;max)], 1.6. where 



(/(I'max) = V^iT^lV^ - V^r^] (148) 

6.3. Onset of remanence-induced discontinuities in the > region 

It is clear that discontinuities emerge in our equations as soon as g < 0. Even if it is not yet 
clear which precise observables will be affected by these discontinuities, it implies that there 
exists an alternative transition marked by the condition q — 0, i.e. by 

c=l~^Al{l + x-') (149) 

When (|149|) holds, we find upon expanding for small q that limg^o A~^(z) = —(Aqz/x)^^^, 
and so along the line (|149p the integrals (|100|l reduce to gamma functions; 



/Aoa/2(1+c)\ 1/3 / / AWl+c\^''^ 1 1 




^ ^gy2(TT^ ^2/3 r f AlVT+-c ^y^ 1 5, 



This leads to 



U{v)-1^ .A^rrA- a = Erf(«)/[l + ^(-)H/3^/^ (152) 
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in which now H = [Ao/x[l + c(w)]]^'''^. Solving the first equation for H gives 



H±W = l^U{v)-2±^[2-U{v)r-72[l^U{v)]V^r{^)/r^^)j (153) 

Again, after combination with the q — condition, we thereby arrive at a parametrization 
of the transition line in the {a, Aq) plane, with u > as a parameter, with two ± branches: 



At(^) = - civ)] - [1 + c{v)]Eliv) (154) 



a±(u) = Erf(?;)/ 



(155) 



(156) 



The corresponding value of x then follows from 
" 3[l-c{v)] 
.2[1 + civ)]El{v) 

To have H±(d) G IR we must demand [U{v) + 2(C - 1)]^ > 4f(^ - 1), where ^ = 
18v/^r(|)/r2(|) ^ 1.1623. Since U{v) > this implies U{v) > 2V|^(V?-V|^) ^ 
0.5441. Secondly, to have G IR and a > we must demand, respectively, H±(ii) < 
[|[1 - c{v)]/[l + c(t;)]]i/^ and H±(w) > -30F/r(i). The third condition is x > 0, which 
translates into: H±(«) > for r = 1, and 'E±{v) < for r = —1. The second and third 
conditions can be combined into 

r = l: 0<E±{v)<[^[l~c{v)]/[l+c{v)]f' (157) 

r = -l: -3^/¥/^(i)<H±(«)<0 (158) 
5 

For small v we may use expansion p44|l . which tells us that U{v) diverges at « = 0, to find 

6r(§) 6w[l+cr2[oo]]0Fr(§) 



i80Fr(^ 

r(i) ' a^Mrd) L r^d) 



„ , , S-v/tt STTwfl + cr^fcxall 



+ Oiv^) (160) 



Hence 



lim a- (v) = — — 161 

^[l + a2M](l8V^r(|)-r2(i)) 



lim Ao (t;) = W^[l-o-2[oo]] +27[l + o-2[oo]]7r3/2/r^(i) (162) 
v^o V 2 6 

For ct[oo] — (i.e. no decision noise) this result gives lim„^o«-(t') = ^^{^)/''^l^8V^^i^) ^ 
r^(|)] 1.9611 and lim„^o^o («) = SVGtv^^^ /T^^^ {^) « 1.3204. For the '+' branch the 
limit v —> does not exist; instead when v is decreased the line terminates at the value Vmin 
such that j4j(iimin) — 0. Finally, the two branches terminate and meet at the value Umax 
such that [?7(umax) - 2f = 2A[1 - (/(umax)], iu which A = 360Fr(|)/r2(i), i.e. where 

(7(«max) = VX^[^ - VX^] (163) 
(note: via the relation r(z)r(l — z) = n/ sin(7r2) one could simplify our expressions further). 

6.4- The Xpt = transition lines 

We saw earlier that Xr can change sign at the x ~ oo line. Here we inspect the possibility of 
having & Xr ~ transition for finite x a-nd finite a. The effective agent equation (|60[) would 
now give q = rj^/a + 6, leading to c = a^[oo] and (f) — 1. The susceptibility would become 

I d 2cr[oo] 
X=^(T=cr)*= (164) 
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The Xr transition line is hence to be solved from the following coupled equations for (x, Q, ^o): 
7i(cr^(oo),x) 



[l + a2(oo) 



<7^[oo]/7r 



(165) 



/2(a2M,x)-i[l + a2(c»)] 
One can use x > as a parameter, solve the first equation for Ao{x), and then calculate 
q(x) via the second. For cr(oo) = 1 (no decision noise) the two equations simplify further to 



1^ Dz zA'^iz) 



— ^ I Dz 

an 



(166) 



We will explore this latter case, where A{z) — z{l + rx) — z'^/Aq and r{z) — ^z{Aq + 3q), in 
more detail. This requires working out the function A^^{z) for the two model instances. 

If r = 1 we have q = — |^o(l + X~^) ^ ~|^oi here we must in the remanent 
regime always select the non-Maxwell option (|132p . We replace x a^s a parameter by 
A = 2|g|^/V(3kl - ^o) > 0. This implies that r{z)/\q\^^^ = -z/X, and hence 

A^'^iz) ^sgii{z)^/\q\ n{\z\/X) (167) 
n{x) = 26'[l-a;]sin(iarcsin(x)) - e[x-l]^^[x+ \/x^ -1]^ + [x-\/x^-l]^^ (168) 



The first equation of p66p then gives ^J\q\ = [JD^ l-^^l^^d^^l/A)] ^ , and we obtain the following 
explicit parametrization of the Xh = line: 

Ao{X)^ . , ,,,, ^ . (169) 



/ Dz \z\n{\z\/X) Y XjDz \z\n{\z\/X) 



.(A) = 



jDz !^'(lzj/A) 
[jDz \zmz\/X)Y- 



- 1 



Let us determine the extremal points. For A ^ 00 we use fl{x) = |a; + -^x + 0{x ) and get 



(170) 

nd get 
(171) 



lim Ao{X) = V3, lim a"^(A) = 

A — -^oo X — »oo 

For small A we note that the Xji = line terminates at the value Ac where ^0 ceases to be 
real-valued. This value Ac is the solution of 

3, 



X Dz \z\Q{\z\/X) 



and corresponds to the following point in the (q, ^0) plane 
^0=0, 



1 

a = — 

TT 



^Ac / Dz q:\\z\/Xc) 



(172) 



(173) 



If r = -1 we have q = -|Ao(l-x ^) and r{z) = ^AIz/x- Here 3q + Al = Aq/x > so 
q > — i^Q, and in the remanent region we select the Maxwell option ([131]). If now we define 
as our line parameter A = 2\q\^^^ /{3q + Aq) > we will have r{z)/\q\^^^ = z/X, and hence 

A~^{z) = sgn(z)y/\^\ n{\z\/X) (174) 

<?>0: n{x) = [x + y^l+x^]-^ + [x-y^l + x^]^^ (175) 

<?<0: n{x) ^ e[x-l]^^[x+y/x^^]^i +[x-^/x^^]i^ +2e[l-x] cos(iarccos(x))(176) 

Again we find the first equation of (|166|) giving -^/^ = [jDz \z\Q{\z\/ X)]^^ , but now our 
parametrization becomes 

^o(A) = . , ,,,, ,1 rr. , ^^. ^TT - 3 sgn(q) 



jDz |zlf7(|z|/A) Y XjDz lzln(|2|/A) 



a(A) 

TT 



jDz n^{\z\/X) 
[jDz \z\n{\z\/X)Y^ 



- 1 



(177) 
(178) 
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Figure 6. Phase diagrams for the models with F[A] = tA[1 - A^/Ag], 
T = ±1. Solid lines: x = transition, dashed lines: remanence onset transition, 
dotted lines: Xe = (minority-to-majority) transition. The MinGame phase is 
characterized by > (contrarian trading), the MajGame phase by Xr < 
(trend-following). R indicates remanence. In the left picture (t = —1, giving 
trend-following for |A| < Aq and contrarian trading for |j4| > Aq), the phase 
diagram is reasonably complete and reliable. For small Aq we have only the 
MinGame phase, with the standard x — > oo transition at etc ~ 0.3374. As Ag is 
increased a small remanent region is formed, until we switch to a MajGame state 
for large Aq. In the right picture (r = 1, giving contrarian trading for \A\ < Aq 
and trend-following for |A| > Aq), we find the MinGame phase, with the standard 
X — > oo transition at ac~ 0.3374, for large Aq (as expected). However, the overall 
picture is now more uncertain since most of the diagram is remanent. Since we 
can never be sure of picking the right solution in the remanent phase, the location 
of the Xh = cannot be taken as certain, and indeed intuition suggests that 
it should have connected to the point where the x = and the remanence onset 
lines meet. In both diagrams we cannot draw the line separating the non-ergodic 
MinGame phase from the MajGame phase for small a; as this line involves non- 
ergodic phases, we have no access to it with a theory that assumes ergodicity. 



In the limit A ^ oo we use the expansions Q{x) — — ^x'^ + O(x^) for g > 0, and 
n{x) = 73 + - ^x'^ + ©(x^) for g < 0. We then find 

g>0: lim A)(A) = \/3^ 1.7321, lima-^(A)=0 (179) 

A^O A— *cxD 

g < : lim Ao{\) = . ^ 1.2533, lim a(A) = , ^ ^, ^ 0.5576 (180) 

A— »oo V 2 X^oo 7V[7V — 2} 

The latter point coincides with the termination point of the x ^ oo transition line for t — —1. 
The Xh = line for r = — 1 can only have a finite A termination point with Aq = if g > 0, 
i.e. in the remanent region. In practice we find no such points for t = —1, irrespective of g. 

6.5. Phase diagrams 

We can now summarize the picture obtained by analyzing time-translation invariant states 
in terms of a phase diagram. The control parameters are a > 0, ^lo > and t — ±1. We 
have so far identified three transition types: x ~' c«i Xh ~* and g — » 0. The result is 
shown in figure |6l and discussed in detail in the corresponding figure caption. Most of the 
technical subtleties in the present models are generated by remanence, so the phase diagram 
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Figure 7. Simulation results for the persistent correlations c, the fraction of 
frozen agents (p, and the volatility cr, for r = —1 (i.e. F[A] = —A + /A'^). 
The chosen values of A^^ should, according to the phase diagram, probe the 
MajGame phase of the model, without any x = °° transition. Pull markers; 
tabula rasa initial conditions; empty markers: biased initial conditions. 



for T = —1 (giving the model of [TT]) is the most complete and reliable, since the remanent 
region is relatively contained. The situation is different for r = 1, where most of the phase 
diagram is remanent, and consequently we cannot be certain of the location of the Xr — line. 
A proper resolution here would require going beyond the asymptotic limit of the effective 
agent and the effective overall bid processes, in order to determine dynamic stability and 
dependence on initial conditions of the values of the persistent order parameters. 

6. 6. Simulations 

We have tested our predictions for the values of persistent order parameters and the locations 
of phase transition lines, for the models (|122p and for both values of r. All simulations were 
carried out without decision noise, for systems of size A'' = 4097 and for both unbiased 
(gi(0) = ±10~*) and biased (q'i(O) — ±1) random initializations. Observables were measured 
during 1000 batch steps, following an equilibration stage of 2000 batch steps. 

We begin with t — —1 (the model of [11)). In figure [7] we present results for the 
volatility a, the persistent correlations c, and the fraction of frozen agents 0, for values of 
^4^^^ corresponding to the MajGame regime, without remanence. The simulations indeed 
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Figure 8. Simulation results for the persistent correlations c, the fraction of 
frozen agents and the volatility a, for r = —1 (i.e. F[A] = —A + A'^/Aq). The 
chosen values of A^^ should, according to the phase diagram, probe the region 
close where a Ao-dependent x = oo transition occurs (indicated with a vertical 
dashed line), with a MinGame phase for large a. Full markers: tabula rasa initial 
conditions; empty markers: biased initial conditions. 

reproduce a majority-game type state for large Aq (top row), but as Aq is reduced (middle 
and bottom rows) the system exhibits behaviour that is less clear-cut than what is suggested 
by the phase diagram. We are still in the non-remanent region, so this cannot be explained 
by remanence effects. Close to the remanent region R of the r = — 1 phase diagram, the 
simulations are in rough agreement with the predictions, see figure [S] The vertical dashed 
line marks the x = co transition, and seems to agree with simulations within the finite size 
limitations. In figure we probe the region where we expect MG-type behaviour. This is 
borne out in the ergodic region, for a > ac (and the transition is found in the right place, 
in agreement with the phase diagram). However, for a < Qc the behaviour is found to be 
far from typical; in contrast to the standard MG, the differences between the biased and 
unbiased initial conditions are small, and more likely to result of instabilities than long-term 
memory. In fact one notes similarities in behavior with figure|4]for F[A] = sgn(j4)|A|'^ with 
7 = 4, 5; this suggest as a possible explanation that if Aq^ gets larger, the first term of the 
present F[A] = A^/A^—A plays a role similar to sgn(yl)|Ap with 7 > 4. 

In figure [TO] we present simulation results for the most difficult case r = 1, i.e. 
F[A] — A — A'^ /Aq. These show that the anticipated transition from a MinGame phase at 
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Figure 9. Simulation results for the persistent correlations c, the fraction of 
frozen agents 4>) the volatility cr, for r = —1 (i.e. F[A] = —A + A'^/Ag). 
The chosen values of A^^ should, according to the phase diagram, probe the 
region close where a x = oo transition should occur at the conventional MG value 
Oc ~ 0.3374 (indicated with a vertical dashed line), with an ergodic MinGame 
phases for large a and a non-ergodic MinGame phase for small a. Full markers: 
tabula rasa initial conditions; empty markers: biased initial conditions. We note 
that the behavior in the non-ergodic regime is not typical of the standard MG. 

small values of A^^ to an MajGamc phase for larger A'^^ indeed occurs, but for some value 
0.25 < ^l^'^ < 0.5, which differs from the prediction in the phase diagram. Furthermore, 
one notes instabiUties of multiplicities of states in the remanent regime, to the right of 
the X = transition. These deviations for r = 1 are of course not unexpected, since 
the T = 1 phase diagram is plagued by remanence. They could be caused by many things, 
possibly in combination: incorrect selection of mathematical solutions in the remanent phase, 
insufficiently equilibrated simulations made worse by remanence, alternative transitions (e.g. 
onset of weak long-term memory), etc. 
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Figure 10. Simulation results for the persistent correlations c, the fraction 
of frozen agents rp. and the volatility cr, for the troublesome case r = 1 (i.e. 
F[A] = A — A'^/Af^). According to the phase diagram, one should for small 
Aq^ find a conventional x = phase separating an ergodic from a non-ergodic 
MinGame phase. For larger A^^ we should at some point enter a MajGame 
phase. Full markers: tabula rasa initial conditions; empty markers: biased initial 
conditions. Although the observed behaviour agrees with the theory for small 
Aq^ , and indeed a MajGame phase appears as A^^ is increased, the point where 
this happens does not agree with the phase diagram. This underlines the problems 
in the identification of transition lines in the remanent region of the phase diagram, 
which are indeed much more profound for r = 1. 
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7. Discussion 

Minority-game type models have an amazing ability to describe new phenomena within an 
accessible mathematical framework, and to throw up new mathematical surprises and puzzles. 
In this paper we have studied generalized agent-based market models of the MG-type (in their 
so-called 'fake history' batch version), in which the agents' strategy valuation update rule 
is allowed to depend on the overall market bid, via an impact function F[A] (which would 
be F[A] — ±A for the standard minority and majority games, respectively). The function 
F[A] allows us to model the effect of agents' interpretation of the state of the market (the 
magnitude of the fluctuations), assuming that whether price fluctuations are perceived to be 
large or small should somehow influence how agents trade in financial markets. Our motive is 
to incorporate into solvable market models such behavioral elements. In this study we focus 
on two model classes: one in which agents are always contrarians, but where we can control 
their greed and willingness to take risks, viz. F[A] — sgn{A)\A\'' , and one in which agents 
can switch between trend following and contrarian trading, viz. F[A] = ±A[1 — A^/Aq], 
somewhat reminiscent of how they would adapt to booming and 'bear' markets. 

At a mathematical level, the generating functional analysis of the present class of models 
requires studying the overall bid evolution explicitly, similar to how one would study models 
with real market history. It turns out that a key issue in working towards closed self consistent 
equations for persistent order parameters is whether the overall bid process is remanent. In 
non-remanent cases, such as F[A] = sgn(y4)|ylp, solution is direct and relatively easy, and 
the agreement between theory and simulations is excellent (for this particular model: unless 
7 becomes too large, where we lose the ergodic phase altogether). In remanent cases, such 
as -F[j4] = tA[1 — /Aq] with r = ±1, we need to rely on ansatze and Maxwell- type 
approximations to select a solution from the possible stationary states, especially for r = 1, 
and the agreement between theory and experiment is consequently limited. 

Once more, what appear at first sight to be simple modifications of the standard MG lead 
to highly nontrivial and unexpected behaviour (even in batch models with fake histories) . As 
soon as agents are allowed to adapt their trading style to the magnitude of the fluctuations, 
in the spirit of one introduces a non-trivial effective overall bid process, with new 

instabilities and new transitions. We are now approaching the point where theories based on 
persistent order parameter equations only, the ones that benefit most from the simplifications 
induced by having 'frozen agents', are no longer giving us the information we need. In models 
dominated by remanence, which are the type one needs when including more realistic agent 
behaviour, we can no longer avoid solving the full dynamics more explicitly. 
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Appendix A. Scaling of overall market bid covariances 

We defined the overall bid covariance matrix as E.u'iz) = {A{t, z)A{t' , z)) . It must be time- 
translation invariant, so we write H(t, z) = 3s+t,s{z), i.e. H(t, z) — {A{s, z)A{t + s, z)}. From 
H78[l we extract: 

S{t, z) = lew - G{s){^{F\A(z) + A{t-s, z)]A{Q, z)) + {F\A{z) + A{-~s, z)]A{t, z))^ 

s 

- G(s)G(s'){[f[A{z) + A{t - s, z)]F[A{z) + A{-s', z)] - f\z)^) (A.l) 

ss' 

Since the non-persistent bids are Gaussian this equation gives an explicit relation from which 
to solve their covariances; along the lines of [15] we apply the general relation 



{G[A{t,z),A{t',z)])= DxDy 



(A.2) 

xG[^^S^{t-t') + ^^S2{t-t'),^^S^{t^t')-^ ^S, [t - t')]] 

where Si{t — t') — H(0, z)+'E,{t — t' , z), S2{t — t') — H(0, z) — H(t — t', z). In particular we need 
the two quantities 



{F[A{z) + A{u, z)]A{v, z)} = E{u-v, z)F'{z) 



(A.3) 



and 



{F[A{z)+A{u,z)]F[A(z)+A{v,z)]) 



DxDy F\A{z) +^^Si(u-v) +^^S2{u-v)] 

X F[A{z) + -^^S,(u-v) - ^^S2{u~v)\ (A.4) 

For u = V this gives simply {F^[A{z) + A{u, z)]) — F'^{z). The first average above is of order 
E. The second average can for m 7^ « be expanded in powers of S(m — v, z) (which should 
decay to zero quickly), using 

/(C) = jDxDyF[A+^^/m+l+^^/m^e\ 

X F p + ^ V^(OHC - ^ ^/iW^] 
= { j Dx F[A + x^W0)]]\i[ Jdx F'[A + xy/E{&)]y + Oie: 



(A.5) 



Thus we conclude that 

{F[A{z) + A{u, z)]F[A{z) + A{v, z)]) - f\z) = 



F^{z)-F (z) 



+ (1 — 5„„)H(u— z) 



{F'{z)y 



+ 0{E{u-v,z)) 



(A.6) 



which leads to 

E{t, z) = \c{t) - F^{z) Y G{s)\e{-s -t,z)+ H(-s + t,z)^ 

s>0 

- 'F^iz)-F\z)'\YGis)G{s^t) 

- nz)fj2 J2 G{s)G{s-t + v)E{v,z)[l + 0{S)] (A.7) 

S>0 V>t—S,Vj!:0 

At this point we inspect how various terms scale. We know from earlier MG work (especially 
from approximate calculations of the volatility, see e.g. [8]) that the relajcation of the response 
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function G is very slow. Upon making an ansatz of the form G{t) — xi'^'^ ~ l)e^''' one can 
show that in the stationary state one must put fj, ^ (the relaxation time seems to diverge 
with A'^ in an as yet undetermined way). For such an exponential ansatz one would find 
J2,->oGis)G{s -t) = x^e-"l*l(e'' - l)/(e" + 1) = 0{^1X^). Thus if ^ the second term 
in (|A.7|I vanishes in the ergodic regime. In the final term we use our earlier ansatz that the 
correlations H(s) decay on short times; formula (|A.7P suggests that this relaxation time will 
be that of C(t). If this relaxation time is rc, we may estimate the scaling of the last term in 
HA.7|) as O(fiTcX^)- So, upon writing the relaxation time of the response function as tq, we 
may replace fi ^ I/tq and write (|A.7|I as 



E{t,z) = ^C{t) 



F'{z)0{rc/rG) 



f\z) 



0{1/tg) 



0{tc/tg) 



(A.8) 



